Adaptive transfer learning
نویسندگان
چکیده
In transfer learning, we wish to make inference about a target population when have access data both from the distribution itself, and different but related source distribution. We introduce flexible framework for learning in context of binary classification, allowing covariate-dependent relationships between distributions that are not required preserve Bayes decision boundary. Our main contributions derive minimax optimal rates convergence (up poly-logarithmic factors) this problem, show rate can be achieved by an algorithm adapts key aspects unknown relationship, as well smoothness tail parameters our distributional classes. This turns out several regimes, depending on interplay relative sample sizes strength achieves optimality careful, tree-based calibration local nearest-neighbour procedures.
منابع مشابه
Adaptive Transfer Learning
Transfer learning aims at reusing the knowledge in some source tasks to improve the learning of a target task. Many transfer learning methods assume that the source tasks and the target task be related, even though many tasks are not related in reality. However, when two tasks are unrelated, the knowledge extracted from a source task may not help, and even hurt, the performance of a target task...
متن کاملTransfer Learning with Adaptive Regularizers
The success of regularized risk minimization approaches to classification with linear models depends crucially on the selection of a regularization term that matches with the learning task at hand. If the necessary domain expertise is rare or hard to formalize, it may be difficult to find a good regularizer. On the other hand, if plenty of related or similar data is available, it is a natural a...
متن کاملAdaptive Feature Ranking for Unsupervised Transfer Learning
Transfer Learning is concerned with the application of knowledge gained from solving a problem to a different but related problem domain. In this paper, we propose a method and efficient algorithm for ranking and selecting representations from a Restricted Boltzmann Machine trained on a source domain to be transferred onto a target domain. Experiments carried out using the MNIST, ICDAR and TiCC...
متن کاملConcept Transfer Learning for Adaptive Language Understanding
Semantic transfer is an important problem of the language understanding (LU), which is about how the recognition pattern of a semantic concept benefits other associated concepts. In this paper, we propose a new semantic representation based on combinatory concepts. Semantic slot is represented as a composition of different atomic concepts in different semantic dimensions. Specifically, we propo...
متن کاملA Transfer Learning Approach for Adaptive Classification in P300 Paradigms
Introduction: The P300 is one of the most widely used brain responses in BCIs today, popularized by none other than the P300 speller itself. However, most systems still require significant subject-specific training to achieve accurate, reliable classification of brain signals. We present an approach to classification that allows for classification with zero subject-specific data and also improv...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Annals of Statistics
سال: 2021
ISSN: ['0090-5364', '2168-8966']
DOI: https://doi.org/10.1214/21-aos2102